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Abstract 

We propose entropy functions based on fractional calculus. We show 
that this new entropy has the same properties than the Shannon entropy 
except additivity. We show that this entropy function satisfies the Lesche 
and thermodynamic stability criteria. 
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1 Introduction 

In the last two decades, there has been a lot of interest in generalizing the 
Shannon entropy and exploring the consequences of applying these new entropies 
to physics and other fields. These entropy functions depend on an additional 
parameter q and become the Shannon entropy function when this parameter 
takes the value 5 = 1. The implications of these generalizations are not merely 
mathematical but in some cases these entropies could be non-extensive opening 
the possibility for applications to systems with long range correlations. 

The most studied generalization of the Shannon entropy, besides the Renyi 
entropy pQ, is the Tsallis entropy [2] 



where pi is the probability . The probability distribution under the constraints 
TliiPi — 1 an d "YliPi^i — E is given by the function 

Pi — 7} ' \ z ) 
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where Z q is the partition function. Many applications of this entropy can be 
found in the literature, not only in statistical mechanics but also in other fields 
like economics, biology, gravitation and high energy collisions [3J. 

More recently, another non-additive entropy was proposed [1] [5] according 
to the function 

S(q)=-T i p!hip i , (3) 



leading to the probability distribution 

p -( zsm \ 1/(1 - q) (4) 

Pl -{(a + bE)( q -l)J ' W 

where the variable z is a function of the energy E and the parameter g, and 
W(z) is the Lambert function [3] defined by 

W(z)e w ^ = z (5) 

In addition, with use of optimization principles, several other entropies (or mea- 
sures) have been proposed [7] [5] to address issues in information theory. One of 
these measures, is the Havrada-Charvat measure given by the function 

S(p : q) = ^ lPl 1 : , (6) 

a — 1 

which is a relative entropy that becomes the Kullback-Liebler measure for a = 1 
and the Tsallis entropy for Pj = 1. 

In particular, in statistical mechanics, the main motivation to propose new 
entropies resides in the hope that they could describe phenomena that lie outside 
the scope of the Boltzmann-Gibbs formalism. 

This paper is organized as follows. In Section [2] we give a brief description 
of fractional derivatives. In Section [3] with use of the fractional derivative we 
define the new entropy, and maximize it subject to the constraint equations 
Y^iPi ~ 1 an d Y^Pi e i ~ and find that the probability distribution has an 
exponential solution for q = 1/2. In Section [4] we study two criteria of stability 
of this entropy function, and in Section [5] we summarize our results. 



2 Fractional Derivatives 

The subject of fractional calculus is one of the many examples of a mathemat- 
ical formalism that, in spite of its long history, it has remained until recently 
practically absent in the physics literature. L'Hopital in 1695 wondered about 
the meaning of d JJ^ for m = 1/2, and it was until the first half of the nine- 
teen century that a precise mathematical formulation of fractional calculus was 
developed thanks to the contributions of mathematicians like N. H. Abel, J. B. 
Fourier, J. Liouville and B. Riemann, among many others [9]. More recently, 
some applications of fractional calculus include the fields of anomalous diffu- 
sion, chaos, polymer science, biophysics, and field theory [1Q]-[T3]. The idea 
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behind the definition of a fractional derivative resides in finding an operator 
that generalizes the equation 



x m - n , (7) 



dx n (m — n)\ 

for arbitrary n € R + , by replacing each factorial by a gamma function 



rfV _ EQx + 1) 



cfe<? T(^-g+l) 
This generalization is fulfilled by defining the operator 



,?>0. (8) 



aA*=(|) (-^rV(*)), (9) 

where n £ N , n > q and 

Equation (p~0|) defines the fractional integral operator. There is also a right 
Riemann-Liouville derivative, which plays an important role in integration by 
parts and it is defined according to 

tD q b = (~Y( t Dr n fm (ii) 



with 



•"rw-Tthtif, <rw^> dt '- (12) 



3 Entropy Functions 



The observation that the Shannon entropy can be defined from the equation 

i 

opened the possibility to define new entropy functions. In particular, it was 
pointed out [14] that the Tsallis entropy can be expressed in an equivalent way 
as0 

S=tonD$X>r*, ( 14 ) 

i 

where the operator D l q is called the Jackson [TS] g-derivative defined as 

D\ = t-^-^—. (15) 



x Our Eq. I|14| l is slightly different than the one proposed by S. Abe. 
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Since the Jackson derivative plays an important role in the formulation of non- 
commutative calculus and thus in quantum groups, it is expected [16] that 
quantum groups may also play an important role in Tsallis formalism. Other 
entropy functions have been defined with the use of variations of the Jackson 
g-derivative [T7] [TS] , a new thermostatistics based on g-analysis [TH] and gener- 
alizations of the Tsallis entropy [5D] . 

Here we use the same approach as in Equation (Ti"4|) but with the operator 
defined in Eq. p0[) with a = — oo. Therefore our entropy is given by the 
equation 



where < q < 1. Therefore, we need to solve the following integral 

S„[p} = lim -f , - V / I -dt'. (17) 



t^-idtT(l-q)^J_ 00 {t-t'Y 

By defining a new variable w = t — t' and with use of the definition of the T(z) 
function 

/■oo 

T(z) = x z t z - x e- tx dt x > , z > (18) 
Jo 

we find, after taking the ordinary derivative and setting t = — 1, that the entropy 
becomes the function 

^^(-lnpOV (19) 

It is clear that S[q] = Si(p) is positive, and from the condition dS g^ =0wc 
see that Si{p) has a maximum at pi — e~ q with a second derivative at this point 
given by d \ Pi=e -q= —q q ~ 1 e q . This maximum will be closed top » 1 for 
g~0 and close to p ~ for q ^ 1. In particular, the binary entropy 

S b q m = p(- lnp) q + (1 - p)(ln(l - p)) 9 , (20) 

has a maximum at p = 1/2. In addition, as expected, this entropy is non- 
additive. Let p = (pi, ...,p m ) an d P = (Pi, ...,P Tl ) be two independent proba- 
bility distributions for systems A and B respectively. The entropy for the joint 
probability is given by 

m n 

S q [A,B] =J2Y,P* P i (-HP>Pi)) q ■ (21) 
i=i j=i 

A simple calculation shows that Eq. (|2"Tj) becomes the infinite series 

m n 

S q [A,B}=S q {A}+Y / Y,Y,&P^- ln PJ k (- lnP ^ q ~ k > ( 22 ) 

i=l j=l k=l 
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such that exchanging P*-»pwe can symmetrize this equation leading to 

S q [A,B] = ~ L q [A] + S q [B]+J2(l)[Sk[A]S q - k [B]+ S q - k [A]S k [B]]^ . 

A simple check shows that we recover the additive property by taking the 
Urriq^iSqlA, B] where S [p] = 1 and Si[p] = S S hannon- 

As is well known, the probability distributions can be obtained by maximiz- 
ing the corresponding entropy function subject to some constraint equations. 
Therefore, we need to maximize 



L = S q \p}+a[ l-5>; ] +/3[E-Y Jli(l ) . (24) 
such that setting 4^- = 0, leads to the equation 

apj 

(-\n P] y -qi-lnp^- 1 = a + f3e 3 . (25) 
For the particular case of q = 1/2 there is an exact solution to Eq. (|25[) with 



pae (-l/2)(tf + V^!l) ] (26) 

where ft = (3e + a. 



4 Stability 

In this section we investigate the stability properties of the new entropy for the 
cases of Lesche and thermodynamic stability criteria. 

4.1 Lesche stability 

In a seminal article Lesche proposed a stability criterion to study the 

stability of the Renyi entropy function. He showed that the Renyi entropy 
is unstable for every value of the q parameter with the exception of q = 1. 
Therefore, under this stability criterion the Shannon entropy is stable. The main 
motivation of this type of stability is to check whether an observable changes 
appreciably when the probability assignments p on a set of n microstates is 
perturbed by an infinitesimal amount dp. This criteria has already been applied 
[23]- [26] to some generalizations of the Shannon entropy. Let p and p' be two 
probability assignments, Lesche stability requires that Ve > we can find a 

5 > such that 

3=1 b « 
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Starting from Eq. (|27[) and an expression for a generalized entropy maximized 
by a probability distribution, the authors of |24) derived a simple condition from 
which Lesche stability can be addressed. In Ref. [23] it is shown that Lesche 
stability is satisfied if 



where the constant C is given by 



On 



c= /- 1 (° + )-f 1 (n , (29) 

and the function is the inverse of the probability distribution. Therefore 

if C ^ , we can take an arbitrary 6 as S — e/C such that the criterion in Eq. 
([27]) is fulfilled. From Eq. ([25]) we see that in our case 



r\t) = (-\nt)"-q(-\nty-\ (30) 
such that replacing in Eq. ([2U]) we obtain 

c = Af-Ht)M+ q ) + q v( q ) =1 > (31) 

and taking <5 = e the inequality in Eq. ([28]) is satisfied and thus Eq. ([27)) . 



4.2 Thermodynamic stability 

As is well known, in the Boltzmann-Gibbs formalism the concavity of the en- 
tropy, < 0, is equivalent to the condition of thermodynamic stability. It has 
been recently shown 25j that for the case of a non-additive entropy the property 
of concavity does not imply thermodynamic stability. The study of thermody- 
namic stability of some non-additive entropies can be found in [25] [26] [27] . Given 
an isolated system composed of two independent and identical subsystems in 
equilibrium in which there is a small amount of internal energy transfered from 

d 2 S 

one to the other, the property -^p- < does not necessarily implies that 

S q (U, U) > S q (U + AU, U - AC/), (32) 

provided that the initial state is a state that maximizes the total entropy. In- 
serting Equation ([2"3"|) into Equation ([3"2"]l and expanding up to (AU) 2 after some 
algebra we find 

> \ S « + E (D + S>'_ k S k ) S' k S' q _ k ) . (33) 
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In the microcanonical picture S q = In 9 n, and we can analyze the summation in 
Equation (|33[) by writing the functions S' k and S' k ' in terms of Sk as follows 

k 

Sk = —Sk-i 
n 

S' k ' = — \ (Sk-x - (fc - l)S*_ a ) 

SkS q -k = S q , (34) 

such that replacing these identities into Equation (f3"3"]> and performing the sum- 
mations we find 

> \s' q ' - {qSq-x + (q- q 2 )S q - 2 ) , (35) 

which due to the fact that S q is a positive and concave function Equation (|35[) 
satisfies the inequality for < q < 1 and therefore thermodynamic stability. A 
simple check shows that the condition > S"(q) is recovered for q = 1. 

5 Conclusions 

In this paper we defined a new entropy function in the context of fractional 
calculus. This new entropy is concave, positive definite and non-additive. Max- 
imizing the entropy subject to the usual constrains leads to an exponential prob- 
ability distribution for q = 1/2. In addition, we have shown that this entropy 
satisfies Lesche and thermodynamic stability. There are several issues one could 
address regarding the proposed entropy. In order to determine whether the 
non-additive property of this entropy implies non-extensivity, it will require to 
compute within this framework the correlation function and correlation length 
for a simple ideal gas and compare them with the q = 1 case. For example, this 
type of calculation was performed in [28] to check the factorization approach 
[29] of Tsallis quantum statistics, and it was found that correlations are smaller 
for g ^ 1 putting into question the crude approximation used in Ref. 29J. In 
addition, it is an open problem in what type of applications could this entropy 
function be successfully used, particularly in those fields where the Shannon 
entropy have presented limitations, as for example in the formulation of algo- 
rithms for image segmentation [30] . We will attempt to address some of these 
questions in future communications. 
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Fig. l:The entropy function for q = 1/2 and the Shannon entropy (q 



;. 2:The probability distribution p(Q) for q = 1/2 and q = 1 
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